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Abstract —Since atmospheric turbulence and pointing errors 
cause signal intensity fluctuations and the background radiation 
surrounding the free-space optical (FSO) receiver contributes 
an undesired noisy component, the receiver requires accurate 
channel state information (CSI) and background information 
to adjust the detection threshold. In most previous studies, for 
CSI acquisition, pilot symbols were employed, which leads to a 
reduction of spectral and energy efficiency; and an impractical 
assumption that the background radiation component is perfectly 
known was made. In this paper, we develop an efficient and robust 
sequence receiver, which acquires the CSI and the background 
information implicitly and requires no knowledge about the 
channel model information. It is robust since it can automatically 
estimate the CSI and background component and detect the data 
sequence accordingly. Its decision metric has a simple form and 
involves no integrals, and thus can be easily evaluated. A Viterbi- 
type trellis-search algorithm is adopted to improve the search 
efficiency, and a selective-store strategy is adopted to overcome a 
potential error floor problem as well as to increase the memory 
efficiency. To further simplify the receiver, a decision-feedback 
symbol-by-symbol receiver is proposed as an approximation of 
the sequence receiver. By simulations and theoretical analysis, 
we show that the performance of both the sequence receiver and 
the symbol-by-symbol receiver, approach that of detection with 
perfect knowledge of the CSI and background radiation, as the 
length of the window for forming the decision metric increases. 

Index Terms —Decision-feedback, free space optical (FSO), 
generalised likelihood ratio test (GLRT), intensity modulation 
/ photon counting (IM/PC), selective-store strategy, Viterbi-type 
trellis-search algorithm. 

I. Introduction 

F REE-space optical (FSO) communications provide high 
data rate transmission with higher security and higher 
flexibility compared with conventional wireless communica¬ 
tions. However, FSO signals are attenuated when transmitted 
through air by atmospheric phenomena such as rain, fog and 
snow that reduce the range of the system and deteriorate 
the quality of the transmission. Also, atmospheric turbulence 
and pointing errors cause fluctuations in the intensity of the 
received signal and further degrade the link performance. Ad¬ 
ditionally, the background radiation constitutes an undesired 
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component to the received signal which also fluctuates due to 
the environmental uncertainty. 

Due to the complexity of phase and frequency modulation, 
intensity modulation (IM) is used for most current FSO 
systems. There are mainly two types of detection methods: 
direct detection (DD) and photon counting (PC), both of which 
require accurate knowledge of the channel state information 
(CSI) and background radiation for reliable data detection. 
In E | 2 ), we have surveyed the literature and considered 
the detection issues for IM/DD systems. In particular, we 
have applied the generalized likelihood ratio test (GFRT) 
principle to design a robust receiver that performs implicit CSI 
acquisition and automatic threshold adjustment. The receiver 
is shown to be able to achieve the error performance of a 
receiver with perfect CSI. In this paper, we will focus on 
IM/PC systems. In ESI, pulse position modulation (PPM) 
is used, which does not require CSI and the background 
information for data detection but has less spectral efficiency 
compared to the IM. With the assumption that the receiver 
perfectly knows the background information and the channel 
model information (CMI), i.e., the statistical distribution of the 
channel gain, in s, a maximum likeliohood (ME) sequence 
detection (MESD) method for the photon-counting system 
is proposed. To simplify the implementation, a fast search 
algorithm called multi-symbol detection (MSD) algorithm, is 
also proposed in s. With this MSD algorithm, the receiver 
performs block-by-block detection and the implementation 
complexity per symbol detection is reduced to 0(log(L)) 
operations, where L denotes the block length. However, the 
requirement of the accurate CMI and background information 
can hardly be satisfied in practice. Eater, a generalised MLSD 
(GMLSD) receiver, which requires no CMI and has a simpler 
form, is proposed in 0 where the same MSD algorithm as that 
in 0 for implementation is suggested. It works with neither 
CSI nor CMI, but requires the knowledge of background 
radiation, which still limits its applicability in time-varying 
environments. In addition, for the receiver in 0, an undesired 
error floor problem is observed. 

The GLRT principle is a very powerful approach for receiver 
design in the presence of unknown channel parameters. Having 
applied it to the IM/DD system in EE), we apply it here to 
the IM/PC system and obtain a robust sequence receiver which 
can automatically and continuously estimate the CSI and the 
background radiation and detect the data sequence accordingly. 
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A Viterbi-type trellis-search algorithm similar to that we have 
introduced in mm, which reduces the search complexity to a 
level that is independent of the observation window length, 
is adopted for efficient implementation. Besides, we use a 
selective-store strategy to overcome the error floor problem 
observed in 0 . To further reduce the implementation com¬ 
plexity, a decision-feedback (DFB) symbol-by-symbol receiver 
is developed. To distinguish our two receivers from others, we 
call our sequence receiver the GLRT sequence receiver and 
our DFB receiver the GLRT DFB receiver. The simulation 
and analytical results show that as the observation window 
length increases, both our sequence receiver and DFB receiver 
can achieve the Genie Bound , which is defined as the bit 
error probability (BEP) of the receiver with perfect CSI and 
background information. Additionally, we slightly simplify the 
GMLSD receiver in 0 and simulate it using our Viterbi-type 
trellis-search algorithm and selective-store strategy. The result 
shows that the error floor can be completely avoided. We also 
simplify the GMLSD receiver in 0 to a DFB receiver. We call 
the original receiver in 0 the GMLSD sequence receiver, and 
call our simplification the GMLSD DFB receiver. Particular 
comparisons and discussions will be given in corresponding 
sections and the advantages of our GLRT (sequence and DFB) 
receivers over the existing receivers will be explained. 

The remaining parts of this paper are organized as follows. 
A mathematical system model of the FSO photon counting 
system perturbed by atmospheric turbulence, pointing errors 
and background radiation is briefly reviewed in section II. In 
section III, we briefly illustrate three existing receivers, i.e. 
the ideal receiver with perfect CSI and background informa¬ 
tion, the MLSD receiver introduced in 0, and the GMLSD 
sequence receiver introduced in 0. We also give a brief 
discussion of the three receivers. In section IV, we present 
our GLRT sequence receiver and the Viterbi-type trellis-search 
algorithm as well as our selective-store strategy. The GLRT 
DFB receiver is introduced in section V, and the GMLSD 
DFB receiver is developed as a special case of the GLRT 
DFB receiver. The performance results of all the receivers and 
discussions are given in section VI. In the last section, our 
conclusions are drawn. The common italic font letters in this 
paper, such as r, m and L, are used to denote scalar quantities; 
the bold non-italic font lower-case letters, such as r and m, 
are used to denote vectors and the bold non-italic font upper¬ 
case letters, such as A r and A^ m , are used to denote memory 
arrays. 


II. System Model 

A. Signal Model 

At each time k , the received signal r(k ) is a discrete Poisson 
random variable with probability mass function (PMF) 00 

P(r(k)\m(k),h,n 3 ,n b ) = 

(n s m(k)h + n h ) r W exp(-(n 8 m(k)h + n b )) 

7(k)! 5 ( ) 

where h denotes the channel gain, n s and n b are the mean 
count parameters due to the transmitted signal and the back¬ 
ground radiation, respectively. Notation m(k) is used to denote 


the transmitted data bit, which takes on either the value “0” 
or “1” with equal probability. Here, we define n r = hn s 
as the the effective count parameters due to the received 
signal and in later parts of this paper, n r and hn s are used 
interchangeably. Consequently, P(r(k)\m(k), h, n s , n b ) and 
P(r(k)\m(k),n r ,n b ) are used interchangeably. 


B. Channel Model 

As in m, the channel gain h is formulated as h = h p h a hi , 
where h p , h a and hi are used to denote geometric spread 
and pointing errors, atmospheric turbulence, and path loss, re¬ 
spectively. In 0, log-normal distribution is adopted to model 
h a for weak turbulence, and Gamma-Gamma distribution for 
moderate to strong turbulence and the negative exponential 
distribution for strong turbulence. Since in 0, it has been 
shown that the Gamma-Gamma distribution can nicely fit the 
channel fading statistics of all turbulence regimes, in this 
paper, we only consider h a is a Gamma-Gamma distributed 
random variable, and the probability density function (pdf) of 
h a is 


Ph a (h) 


2 ( q / 3)( a +^/ 2 (a+p)/2 -i 

T(a)m 

x K a -p (2 \Zaf3ttj , h > 0, (2) 


where K a f) is the modified Bessel function of the second 
kind, and 1//3 and 1/a are the variances of the small and 
large scale eddies, respectively. Pointing error influence on an 
FSO system is discussed in 0 and 0, and we here use the 
model in m where the pdf of h p is given as 


Ph p {h) = 7 2 h j2 l /Al , 0 <h< A 0 . ( 3 ) 


Parameters Ao and 7 are constants, and further details can 
be found in 0. In Q] 0, the path loss hi is considered as 
a deterministic variable. This is rigorously wrong since hi 
depends highly on the distance between the transmitter and 
the receiver and the atmospheric condition which is definitely 
time-varying. However, if we only consider a short range of 
time, e.g. on the order of seconds, hi can be regarded as 
a constant. Since we only consider the receiver side signal- 
to-noise ratio (SNR) which is defined later in ([6]), we can 
incorporate hi into h a which amounts to setting hi = 1. Then 
for a turbulent channel with pointing errors, the channel gain 
is h = h a h p , and its pdf can be derived by performing 

Ph(h) = / jlj- Ph a (a)p hp {/Aj da, h > 0, (4) 

where Ph a { a ) is the pdf of h a , and can be found in 0. 
It should be emphasized that © is not an always-correct 
expression for the pdf of h since we artificially set hi as 1. If a 
receiver highly depends on the knowledge of Ph{h), using 0 
is inappropriate. In our work, we will show that our receiver 
does not depend on Ph{h ), and 0 is only used to present 
some numerical results. 

As pointing errors are considered as well as atmospheric 
turbulence in our paper, the scintillation index (SI), which is 
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defined as the normalised variance of the irradiance fluctua¬ 
tions due to atmospheric turbulence | 0 [lOl, is 


E [{Jlaf] 

mha\ 


-i, 


(5) 


but not E[ft 2 ]/E 2 [ft] — 1. Since we use the Gamma-Gamma 
fading model, the SI can also be calculated according to 
SI = a~ l + /3 _1 + (<y/3) - 1 (8]]. The received signal-to-noise 
ratio (SNR), which is defined as the ratio of the squared 
expected mean of the information bearing component to the 
total variance of the received signal (6j ilTJ, is 


SNR = 


C n s E[h ]) 2 
(2n s E[h\ + 4 n b ) ’ 


( 6 ) 


Specifically, if pilot symbols are required, for example, there 
are P pilot symbols and D data symbols in every data packet, 
the effective SNR is given by 


P + D 

SNR e = —^—SNR. 


(7) 


Since the time scales of the fading processes are of the 
order of 10 -3 s to 10 ' - 2 s E2, which is far larger than the bit 
interval (« 10 -10 s for multi-Gbps systems), ft is considered to 
be constant over a large number (> 10 5 ) of transmitted data 
symbols. In general, the FSO system is exposed to ambient 
light, which is random and time-varying, hence the assumption 
made in (3}{6l that n 5 equals 39 constantly and is known 
at the receiver side, is not realistic in practice. According to 
the experimental results reported in [13 , 14], the photocurrent 
due to background radiation is commonly in the kilo-hertz 
region. For some special source, e.g., the Fluorescent lamps 
geared by electronic ballasts, the photocurrent fluctuates in the 
mega-hertz region. Thus, it is more reasonable to assume that 
the background radiation strength (both natural or artificial) is 
time-varying but keeps coherent during intervals of the order 
of 10 _7 s - 10 - 6 s. Thus, with this assumption, the effective 
count parameter due to background radiation has a coherence 
time roughly on the order ofl0 _ 7 s-10 _ 6 s. Thus, the channel 
coherence length L c , which is defined as the number of data 
symbols over which ft and n 5 can be regarded as constants, is 
of the order of 10 3 . 

It should be emphasized that for our proposed GLRT 
receivers, the observation window length L w is much shorter 
than L c , i.e., L w <C L c . Thus, within the observation window 
with length L w , we can treat n S9 n 5 and ft (including n r ) as 
unknown but non-random constant parameters. In our receiver 
design introduced in sections IV and V, the values of n s and 
n r , and the distribution of ft are not required. We only use the 
distribution of ft and choose appropriate parameter values to 
run simulations and to show numerical results in section VI. 


III. Existing Receivers 
A. The Ideal Receiver 

The ideal receiver is considered as a benchmark for the 
performance analysis of all other receivers in this paper. It 
is assumed to accurately have all the information, i.e., the 


accurate values of rib and n r , for detection. When n r 7 ^ 0, 
i.e., P(r(k)\l,n r ,ni J ) 7 ^ 0 , the decision rule is given by 

P(r(k)\0,n r ,n b ) ^ 

P{ r (k)\^-> n r-> n b) rh{k) = l 

where rh(k) denotes the decision on m(k). When 715 = 0 , 
obviously, we have 

P(r(k)\0,n r ,nf,) = { J ; elsewhere ' (9) 

Thus, the decision rule when rib = 0 is 

* (u x _ / 0 ,r(ft) = 0 

^ | 1 , elsewhere 

When rib > 0, by substituting the signal PMF into ([ 8 | and 
simplifying it, the decision rule is reduced to 

rh(k)=l f n \ 

r(k) ^ n r /In ( 1 + — ) . (11) 

rh{k )=0 \ Hb J 

The average bit error probability (BEP) over all possible 
channel states is given by 

P(e\n s ,n b ) 

°° P(e\0,h,n a ,n b ) + P(e\l,h,n a ,n b ) 

--- Ph{h)dh, (12) 

where P(e\0, h, n s , rib) is the probability that a “0” is trans- 
mitted but a “ 1 ” is the decision made by the receiver, condi¬ 
tioned on a given channel parameter combination (h,n s ,rib)\ 
similarly, P(e|l, h, n s , rib) is the conditional probability that 
a “1” is transmitted but a “0” is detected. The value of 
P(e|0, h, 77 s , rib) and P(e|l, h, n s , rib) can be evaluated by 

P(e|0, ft, n 8 , n b ) = P{r{k) > r) = 1 - P(r, n b ) (13) 



and 

P(e|l, ft, n s ,n b ) = P(r(i) < r) = P(r, hn s + n b ), (14) 

where P(ft, A) is the cumulative distribution function (cdf) of 
a Poisson distribution with parameter A. In (13] ) and r 
denotes the decision threshold, i.e., r = In (1 + n r /rib). The 
average BEP obtained from © is also referred to as the Genie 
Bound. 

From ( fT~2] ) - (l4| ), we see that the error probability is related 
to n s , rib and the pdf of ft. Unlike some other systems, the 
SNR value alone cannot determine the BEP here. For example, 
if n r = 50, rib = 25, the corresponding SNR is 12.5 and BEP 
is 1.17 x 10 -4 ; if n r = 100, rib = 150, the corresponding SNR 
is till 12.5 but BEP changes to 1.80 x 10 -4 . 

Also, we see that increasing the value of rib will decrease 
the SNR and thus degrade the system performance, even for 
the ideal receiver. For receivers using an inaccurate value of 
rib , the error performance is further degraded. We will show 
that our proposed receivers can approach the ideal receiver’s 
performance, but not completely cancel the background radi¬ 
ation. 
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B. The MLSD Receiver 

A MLSD receiver for the MIMO photon-counting system 
has been introduced in 0, and here we just introduce its 
SISO case. It assumes that at the receiver side the channel 
model information, together with the value of n b which is 39 
constantly, is available perfectly. At each time k, we consider a 
subsequence m(fc, L) of the immediate past L transmitted data 
symbols given by m(fc, L ) = [m(k — L- hi),..., m(k)\, where 
m{i) G {0,1}, Vi. Similarly, r(fc,L) = [r(k — L + l), .., f r(k)] 
is used to denote the corresponding received signal subse¬ 
quence. The MLSD receiver performs joint detection on the 
transmitted subsequence based on 

m(/c,L) = arg max P(r(k, L)\m(k, L),n b ) 

m (k,L) 
poo k 

= arg max / j| P{r{i)\rn{i), h, n b )ph(h)dh. 

Mk,L)Jo i= t L+ l 

(15) 

By eliminating irrelevant terms in (13] ), the decision rule is 
reduced to 


its partner R on = G on (N on ). According to 0, the MSD 
sequence will correspond to the estimate N on which satisfies 

7V 0 n = arg max A 0 (N on , G on) • (22) 

By using the reverse mapping of the sorting associated with 
( [20] ), the final decision m(fc, L) can be generated. Specifically, 
ones will be assigned to the indices corresponding to the 
largest values of r(k) in r, and zeros will be assigned to the 
remaining L — N on elements of m(fc, L). 

In summary, O(L log 2 L) operations are required for sorting, 
O(L) to calculate G on (N on ) for all N on , and O(L) to perform 
the L metric evaluations. Thus, the algorithm has an overall 
complexity of O(L log 2 L) operations per L symbol decisions, 
or 0(log 2 L) operations per symbol decision, and is only 
logarithmically dependent on L. This is a significant reduction 
relative to the complexity of a brute force search, which is 
0(2 L /L) on a per symbol decision basis. 

C. The GMLSD Receiver 


rh(/c, L) = arg max Ao(m(fc,L)), (16) 

m (k,L) 

where 

A 0 (m (k,L))= n^ + i^M'L)) 

Jo n b 

x exp(—(n s JVo n (m(fc, L))h + n b L))p h (h)dh (17) 

denotes its decision metric for subsequence m(fc, L). Notation 
m(fc, L) is used to denote the decision on m(fc, L). Quantities 
N on (m(k 1 L)) and i? on (m(fc,L)) are defined as 

k 

N on (m(k,L)) = ^2 ( 18 ) 

i=k —L+l 


i?on(m(fc,L)) = m{i)r(i). (19) 

i=k— L+l 


This GMLSD receiver is proposed in 0. It assumes that 
the channel model information is unavailable at the receiver 
side; but the value of n b is 39 constantly and known by the 
receiver. This GMLSD receiver jointly decides on m(fc, L) 
and h that maximize P(r(fc, L)|m(fc, L), L, n b ), which is the 
PMF of the received subsequence and is given by 

P(r(fc, L)\m(k, L), h, n s ,n b ) 

k 

= 11 P(r(i)\m(i),h,n s ,n b ) (23) 

i=k —L+l 


We use h to denote the estimate of h. For a given m, the 
solution of equation 


dP(r(k,L)\m(k,L),h,n s ,n b ) _ 
dh 


(24) 


which is given by 


For simplicity of notation, we drop the dependence on m(fc, L) 
for AT on (m(fc, L)) and R on {m(k,L)) and use N on and R on 
instead, but it should be emphasized that N on and R on are 
functions of m (k,L). This MLSD receiver performs block- 
by-block detection using a multi-symbol detection (MSD) 
algorithm 0. Blocks with length L are considered. To find 
the optimal MSD solution in practice, we first let 


h{m(k, L)) = ( - rib') (25) 

\N on ) n s 

makes P(r(fc, L)|m(fc, L), ft, n s , n b ) achieve its 
maximum value. By substituting h = h(m(k, L)) into 
P(r(fc, L) |m(fc, L), h, n s ,n b ) and eliminating irrelevant 
terms, the decision metric becomes 


g( i) > g( 2) > ... > g(L) (20) 

denote the sorted values of r(fc), ordered from the largest to 
the smallest. Secondly, we define G on (N on ) to be the sum of 
the N on largest values of r(fc); that is 

N on 

<Ln(iVo„) = y>(+ (21) 

i= 1 

To determine what value of N on maximizes the MSD metric, 
© must be evaluated for each N on = 0,1,...,L, using 


/ TD \ ^on 

A 1 (m(A:, L)) = —exp(-P on + n 6 7V on ) (26) 

Similar to fT6] ), this GMLSD receiveris decision is 

m(A:, L) = arg max Ai(m(fc,L)). (27) 

m (k,L) 

It also performs block-by-block detection and uses the MSD 
algorithm introduced in 0 and briefly introduced in the 
previous subsection. 
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D. A Brief Summary and Discussion 

In implementation, the ideal receiver must have exact values 
of h , n s and rib. However, in practice, without channel estima¬ 
tion, knowing these values is impossible. Using pilot symbols 
to estimate these parameters reduces bandwidth and energy 
efficiency, and thus obviously is not desirable. In this paper, 
we do not consider channel estimation with pilot symbols. 
The performance of the ideal receiver is just referred to as a 
benchmark when analysing other receivers’ performance. The 
benefit of the MLSD receiver proposed in 0 is to obviate 
the need for accurate values of h. Nevertheless, the evaluation 
of its decision metric which involves complicated integrals de¬ 
mands high computational capability of the receiver hardware. 
The search complexity of the MSD algorithm increases with 
the number of symbol decisions in the block. As long blocks 
are preferred for better performance, a large complexity seems 
inevitable and receiver hardware with very high computational 
capability is a prerequisite. Besides, when performing block- 
by-block detection, using a large block length L brings a long 
system delay. Even if a powerful processor is available, the 
requirement that the exact distribution of h and the exact 
value of rib be known makes the implementation impractical. 
The GMLSD receiver, introduced in 0, does not require the 
distribution of h to be known. Another benefit is that the 
evaluation of its decision metric can be easily performed since 
no integrals are involved. However, the undesired features 
due to the MSD algorithm, such as a high search complexity 
and a large system delay, still exist. Besides, an error floor 
problem is observed in (6). Furthermore, since the accurate 
value of rib is required, the performance of this GMLSD 
receiver may deteriorate when the receiver is exposed to time- 
varying ambient light. 

In later sections of this paper, we will develop new receivers, 
and propose new implementation methods to overcome all the 
problems mentioned above. 


IV. The GLRT Sequence Receiver 
A. Decision metric design based on the GLRT principle 

As discussed previously, the receiver is likely to be exposed 
to time-varying, environmental ambient radiation, even though 
by employing a well-designed shade, an optical filter, or both, 
the ambient light component can be decreased. Nevertheless, 
a residual component with weak but time-varying intensity is 
inevitable. Since the value of rib is unavailable at the receiver 
side, the GLRT sequence receiver jointly decides on m(&, L), 
n r (= hn s ) and rib that maximize P(r(&, L)|m(fc, P), n r , rib). 

At time k , the PMF of the received subsequence is 

k 

P(r(k,L)\m(k,L),n r ,n b ) = P(r(i)\m(i),n r ,n b ) 

i=k—L +1 

(28) 

For a given m, the solution of the simultaneous equations 

dP(r(k,L)\m(k,L),n r ,n b ) 


dP(r(k,L)\m(k,L),n r ,n b ) 

dn b 


(30) 


makes P(r(k,L)\m(k,L),n r ,n b ) achieve its maximum 
value. We first get the solution of {29} , which is 

n r =h r (m(k,L)) = ~n b ^j , (31) 

By substituting the solution n r = n r (m(fc, L)) back into 

P(r(k, L)\m(k, L), n r , n b ), we have 


P(r(k, L)\m(k, L), h r , n b ) 


on+fl°ff exp (~n b L) / Ron 

nlk-L+i(rm Uonnt 


-Ron 

exp( Ron + n b N on ), 
(32) 


where N on and R on have been defined in < fl~8| > and {T9} , re¬ 
spectively. Next, we differentiate P(r(k, L)\m(k, L),h r ,n b ) 
with respect to n b ; and then, similarly, the solution of equation 
{29} is obtained as 


n b = h b (m(k, L)) 


N oS (m(k,L))' 


(33) 


In {33}, iV 0 ff(m(fc, L)) and P 0 ff( m (^ L)) are functions of 
(m(fc,L)), and they are defined as 


and 


k 

N oS (m(k,L)) = ^ (!-«+)), (34) 

i=k — L+l 

k 

Ros(m(k,L)) = ^ (1 -m(i))r(i). (35) 

i=k — L+l 


Similar to N on and R 0 n , for simplicity of notation, we also 
drop the dependence on m(fc,L) and use 7V 0 ff and P 0 ff 
instead. After substituting the solution rib = R&(m(&,P)) 
back into P(r(fc, L)|m(fc, P), n r , rib) and eliminating irrele¬ 
vant terms, we obtain the decision metric 


+ (m(fc, L)) 


Ro«\ R ° !f (Ron\ 

NoJ \N on ) 


(36) 


However, in simulation, we observed that the value of some 
parts in the metric ( [36] ) would become too large and cause 
a memory overflow problem on the computer (larger than 
lO 500 ). Hence, by taking ln() of the right side of ( [36] ), we 
obtain our GLRT sequence receiver’s decision metric 


A 2 (m (k,L)) = l+A^fm+L))) 

<37) 

Similar to fib] ) and ( [27] ), the decision of this GLRT sequence 
receiver is made by performing 


rh(/c, L) = arg max A 2 (m(fc,L)). (38) 

m (k,L) 

It should be noted that when the observation window size is 
very small and the background radiation is very weak, i.e., 
the rib value is very small, P Q ff is very likely to be zero. 
When P 0 ff = 0, for both receiver hardware and simulation 
software, there might be an ambiguity in evaluating the term 
Poff in () of the decision metric ( [37] ). Thus, we use the 
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Fig. 1. Two survivors in a trellis diagram 
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Fig. 2. Memory usage with the Selective-Store Strategy of the GLRT 
sequence receiver 


limit of that term when R 0 q —>> 0 to define its actual value at 
L off = 0 , i.e., in implementation, we pre-define 


RqH Iff 


RqS \ 

N^J 


R O fi=0 


lim In 

-R 0 ff —>-0 


RqS \ 

N^J ’ 


(39) 


which can easily be shown to be zero. 

Clearly, no integrals are involved in the GLRT sequence 
receiver decision metric ((371., resulting in low computational 
complexity. It does not require any knowledge of the fading 
distribution, and therefore is robust and practical. Additionally, 
since the value of is not required in ( [37] ), compared to the 
GMLSD receiver proposed in m , our GLRT sequence receiver 
is more practical for implementation. In a later section, we 
will show it is robust in slowly time-varying environments, 
regardless of the distributions of h and the value of n 5 . 


B. Implementation 

In implemention, we adopt the Viterbi-type trellis-search 
algorithm and the selective-store strategy similar to what we 
have introduced in mm for implementing the decision metric 
( [37] ) that we use for selection of survivors. A trellis diagram 
is shown in Fig. [T] where there are two nodes at each time k 


and each node is labelled corresponding to data symbol “0” 
and “1”. For each node, there are two paths entering it and 
the Viterbi-type trellis-search algorithm keeps the one with a 
higher metric value and discards the other. Thus, at each time 
k, only two paths exist as survivors and the tail before the 
merge point of the two survivors give the firm output decisions. 

The selective-store fundamental is the same as that in m 
but the specific strategy is modified here. We name the part 
before the merge point the detected part, and the part after, 
the ongoing part. Also, we name signals that are detected to 
carry data symbol “1” the 1-detected signals; and similarly, 
the 0-detected signal is defined as the signal that is detected 
to carry data symbol “0”. Clearly, R on can be obtained 
as Ron — Ron— detected H - Ron— ongoing? and similarly for 
W 0 n? Rofi and W 0 ff. In this selective-store strategy, we keep 
the values of Won—detected and Woff—detected the same, i.e., 
W on 

— detected — v off 

— detected — L/2. As shown in Fig. [2| 
there are two memory arrays A^ r and A) ir in the receiver. 
We selectively store the most recent L/2 0-detected signals 
in A? dr , and the most recent L/2 1-detected signals in A dr . 
In operation, when a new 1-detected (0-detected) signal is 
detected, the system drops the oldest 1-detected (0-detected) 
signal stored in A dr (A dr ) and puts the new signal in. In 
this way, the values of L on -detected and L 0 ff-detected can 
be calculated by recursively subtracting the oldest and adding 
the newest. For the on-going part, we use arrays A Q orn and 
A) jm to store the two survivors and array A® r to store the 
undetected signals. The values of Ron —detected? RfE n —detected? 
Won-detected and W off _detected are calculated based on the 
values stored in arrays A£ m , A* m and A° r . In Fig.[2j d and l 
are the lengths of the sequence ongoing part and the memory 
array for storing the ongoing part. Apparently, d is a random 
variable. In simulations, we observe that the average value 
of d is smaller than 3 and to ensure d < /, we set l = 30 
in implementation. We can see that the metric evaluation 
complexity with our selective-store strategy is still very low 
and independent of L. 

After adopting the selective-store strategy, the receiver is 
probably not using a subsequence with consecutive signals to 
form the decision metric ([37]) because it is with a high prob¬ 
ability that there are unequal numbers of 0-detected signals 
and 1-detected signals in a subsequence with length L. We 
use L' to denote the length of the effective subsequence, in 
which mini# of zeros, # of ones} = L/2. Thus, the whole 
observation window length L w is L w = L' + d. In order to 
perform robust data detection, we should ensure L w <C L c . 
Apparently, L w is of the same order of magnitude of L and 
since L < L c , we have L w < L c . 

V. The DFB Receivers 
A. The GLRT DFB Receiver 

In this subsection, we propose a DFB symbol-by-symbol 
receiver to further reduce the implementation complexity. We 
use m(k) to denote the decision result at time k, and m(fc — 
1; L) = [m(k — L),..., m(k — 1)] to denote the decision result 
vector at time k — 1 with length L. 

As symbol-by-symbol detection is performed here, at time 
k, all the detection results before k should be available at the 
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receiver side. Thus, when detecting the kth symbol, we can 
consider two hypothesis sequences, which are [m(fc — 1, L), 1] 
and [m(fc — 1,L),0]. By comparing the two corresponding 
decision metrics, and discarding the one with smaller value, 
we can make the decision. Formally, the detection at time k 
can be made by performing 


We store the L most recent 1-detected data symbols. After 
simplifying ( [44] ), we obtain 

rh(k)=1 

vo{Ron,RoS,r{k )) ^ 0, (45) 

rh(k )=0 


where 


rh(k) = 1 

A 2 ([m(fc - 1,L), 1) ^ A 2 ([m(fc-1,L),0]). (40) 

rh(k )=0 

As this is a symbol-by-symbol detection, trellis-search is not 
required here; while the selective-store strategy is adopted. We 
store the L most recent 1-detected data symbols as well as the 
L most recent 0-detected data symbols. In this way, N 0 ^ and 
N on both equal L, constantly. We simplify ( [40] ) and then obtain 

rh(k )=1 

^(^on,-Roff,^on,^off/WD ^ 0, (41) 

rh(k )=0 

where 


4/(.Ron, iZoff, Won, Woff, r(k)) 

Woff Hb 1 Ron + r(k) 


=r(k ) In 


Roft + r(fc) W o: 


1 


Ron 


W on + 1 Ro 


Ro 


— Roft in 


■ r(k) W 0 

i?off + y(fc) W off 
Woff + 1 i^off 


(42) 


Similar to the case of ( [37] ), when R 0 ff = 0, we have a problem 
in evaluating the value of R 0 ft In ^ • Thus, we 

define 


to i ,'i2off + r(fc) W off \ 

R “” ln| JV„„ + 1 wj 


- lim i? 0 ff In 

-Roff —>-0 


■Roff =0 

Roe + y(fc) W Q ff \ _ ^ 

Woff + 1 i?off / 


(43) 


As this DFB receiver © is obtained by simplifying ( [38] ), 
we call receiver © the GLRT DFB receiver. It is obvious 
that the implementation complexity of receiver ([41]) is lower 
than that of receiver ( [38] ), because each time only one metric 
is required to be evaluated and no searching is performed. In 
later sections, we will compare the performance of the two 
receivers. In the same way, based on (27} , we develop a DFB 
receiver, which can be seen as a special case of ©• 

In Appendix A of this paper, we analytically show that as L 
increases, the BEP of the GLRT DFB receiver can approach 
the Genie Bound. Since the GLRT DFB receiver is a simplified 
version of the GLRT sequence receiver, apparently, so does the 
GLRT sequence receiver. 


B. A Special Case - The GMLSD DFB receiver 

Similar to ( |40| ), detection can also be made by performing 

rh(k)=1 

Ai([m(fc — 1, L), 1]) ^ Ai([m(fc — 1, L), 0]). (44) 

m(k)=0 


*o(R on, -^off, T'i.k')') 


=(Ro 


-^on lfr 


r(fc)) In 
Ron 


Ro 


~iky\ 


(W on + 1)^6 J 

— r{k ) 


n b . 


(46) 


^ W on ?7fr , 

Similarly, this receiver is called the GMLSD DFB receiver 
and it is with lower implementation complexity compared to 


VI. Simulations and Results 

As mentioned in section II, in this paper we only use the 
Gamma-Gamma distribution to model h a . For the weak turbu¬ 
lence channel, parameters are set as a = 17.13, (3 = 16.04 and 
the corresponding SI = 0.1244; and for the strong turbulence 
channel, a = 2.23, /3 = 1.54, and SI = 1.3890. We choose 
parameters A 0 = 0.0198 and 7 2 = 2.8071 for ([3]) for the 
pointing errors. Similar to 0, without loss of generality, the 
pdf of h has been normalized such that the mean channel gain 
is unity, i.e. E [h\ = 1. In all the figures, each curve with a 
legend “num.” is obtained by numerical integration; and the 
one with a legend “sim.” is obtained by simulation. 

For different SI values (0.1244 and 1.3890) and different 
n b values (from 5 to 100), the simulation results obtained by 
implementing the PC SI receiver © are in complete accord 
with the corresponding results by numerically integrating the 
BEP formula ( [12] ). Hence, in this paper, when referring to the 
performance of the PC SI receiver, we only give the numerical 
integration results. 


A. Sequence Receivers 

In Fig. [3] we plot the performance of the GMLSD sequence 
and the GLRT sequence receiver with different n b values. Both 
receivers are implemented with the Viterbi-type trellis-search 
algorithm with the selective-store strategy. In Fig. |3(a) where 
n b = 39, we can see that when L = 1, the power loss of 
the GMLSD sequence receiver (with the precise knowledge 
of n b = 39) compared to the PCSI receiver is very small, ap¬ 
proximately 0.3 dB; and the power loss of the GLRT sequence 
receiver when L = 2 is slightly larger, at approximately 1 
dB. When the value of L increases to 8, the power loss of 
the GMLSD sequence receiver cannot be observed; i.e., the 
performance achieves that of the PCSI receiver. For the GLRT 
sequence receiver, to achieve the Genie Bound, L needs to be 
no less than 32. This is because the GLRT sequence receiver 
has to estimate two channel parameters {n r and n b ), but the 
GMLSD receiver only estimates one ( n r ). When the system 
memory length increases, both sequence receivers can estimate 
unknown channels almost perfectly and thus achieve the Genie 
Bound. We are interested in how the two sequence receivers 
will perform if n b is not perfectly known at the receiver. 
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Fig. 3. 




SNR(dB) 


(a) n b — 39. 



SNR(dB) 

(b) n b = 20. 



SNR(dB) 

(c) n b = 60. 

Performance of sequence receivers. 


Fig. 4. Comparison of the MSD algorithm and the Viterbi-type trellis-search 
algorithm for the GMLSD sequence receiver; a = 2.23, = 1.54, i.e., 

SI = 1.3890, but pointing error is not considered. 


In Fig. |3(b)| where n b = 20 and Fig. |3(c)| where n b = 60, 
we show the simulation results for both receivers. Similar to 
that in Fig. 3(a) our GLRT sequence receiver suffers from an 
approximate 1 dB power loss compared to the Genie Bound 
when L = 1, and achieves the Genie Bound when L = 32. 
However, we can see that the performance of the GMLSD 
receiver deteriorates whenever n b increases or decreases. Even 
with a very large value of L , i.e., L = 100, since it does 
not know that the n b value has been changed from 39, its 
performance cannot converge to the Genie Bound. 

Since we adopt the Viterbi-type trellis-search algorithm, we 
can simulate these two sequence receivers efficiently with 
any arbitrary large value of L (L <C L c ) to achieve the 
optimum performance. The adoption of the selective-store 
strategy helps us efficiently use the memory and completely 
avoid the potential error floor. 

When implementing the GMLSD receiver, the MSD algo¬ 
rithm proposed in 0 is adopted by the authors of 0 , where an 
error floor is observed with low L values. We also simulate the 
GMLSD sequence receiver using our Viteri-type trellis-search 
algorithm with selective store strategy and plot the results 
in Fig. [4] We can clearly see that, with our implementation 
method, the GMLSD sequence receiver performs much better 
and also completely avoids the potential error floor. 


B. DFB Receivers 

By simulation, using the same channel conditions (turbu¬ 
lence conditions, SNR, n b value and L value), we find that 
the DFB receivers have almost the same performance as their 
corresponding sequence receivers. Thus, readers are suggested 
to refer to Fig. [3] and we do not replot them. Here, we present 
the DFB receivers’ performance where n b is chosen randomly 
from 10 to 100 with equal probability. Since the background 
radiation condition (the statistical distribution of the radiation 
strength) might be different in different situations, in our work 
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5 10 15 20 25 

SNR(dB) 

(a) SI=0.1244. 



(b) SI=1.3890. 

Fig. 5. Performance of DFB receivers, where ni is randomly chosen from 
10 to 100. 


here, we just use this randomly chosen nb to test the robustness 
of our receivers. First, in Fig. [5j we plot the simulation 
results of both our GLRT DFB receiver and the GMLSD DFB 
receiver. We can see that our GLRT DFB receiver achieves 
the Genie Bound with L = 32, but the GMLSD DFB receiver 
cannot. 

Next, we plot the performance results of the GLRT DFB 
receiver in Fig. [6] compared to the GLRT sequence receiver. 
We can see that the GLRT sequence receiver performs slightly 
better than the GLRT DFB receiver when L = 2. When 
L increases, the BEP of the GLRT DFB receiver can also 
approach Genie Bound. 

In Fig. [7J we plot the GLRT DFB receiver’s performance 
with different values of L. It can be seen that, as L increases, 
the performance approaches the Genie Bound asymptotically. 


10 12 14 16 18 20 

SNR(dB) 

Fig. 6. Performance of both GLRT receivers, where rib is randomly chosen 
from 10 to 100. 



Memory Size 

Fig. 7. Performance with different memory lengths; SI=0.1244, rib = 70, 
SNR = 17dB 


C. Discussion 

Based on the results shown in the previous subsection, we 
have shown that sequence receivers can be implemented using 
the Viterbi-type trellis-search algorithm and the selective- 
store strategy with lower complexity and better performance 
compared to the MSD algorithm. The error floor problem, 
which is observed in (6) and cannot be mitigated by the MSD 
algorithm, is now overcome completely. 

When rib is a constant and known at the receiver side and 
the value of L is small, the GLRT receivers cannot perform 
as well as the GMLSD receivers, because the GLRT receivers 
always regard the value of rib as unknown and have to estimate 
it with insufficient samples. Thus, the GMLSD receivers are 
suggested only when the receiver memory size is a constraint 
and the value of rib is constant and accurately known at 
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the receiver side. Otherwise, the GLRT receivers, with more 
robust performance and require no knowledge of n&, are highly 
suggested. 

Though the DFB receivers do not perform as well as their 
corresponding sequence receivers at the same value of L, the 
DFB receivers are recommended because of much lower mem¬ 
ory requirements. We always have to preserve several memory 
arrays for the sequence receivers to store the ongoing part of 
survivors. Besides, the sequence receivers have a potential to 
introduce a long system delay when the two survivors are 
very long before they merge. On the contrary, since the DFB 
receivers perform symbol-by-symbol detection, memory arrays 
to store survivors are not necessary and no system delay exists. 
In addition, we observed that by increasing the value of L very 
slightly, the DFB receiver can perform better than the sequence 
receiver. 


VII. Concluding Remarks 

To mitigate the effects of atmospheric turbulence, pointing 
errors and background radiation, we have introduced new 
GLRT receivers (the GLRT sequence receiver and the GLRT 
DFB receiver) for FSO photon counting systems. These GLRT 
receivers both can perform ML estimation of the unknown 
channel gain and background radiation implicitly, and detect 
the data accordingly, while requiring no prior knowledge 
about the channel and the environment. Thus, they are ro¬ 
bust and work well in any slowly time-varying environment. 
Using the Viterbi-type trellis-search algorithm as well as the 
selective-store strategy, the GLRT sequence receiver can be 
implemented efficiently; while the GLRT DFB receiver is a 
more efficient option. By simulation and theoretical analysis, 
we have shown that the performance of the GRT receivers 
approaches the Genie Bound as the observation window length 
increases. 

When the background radiation is constant and perfectly 
known at the receiver side, the performance of the GMLSD 
receivers (the GMLSD sequence receiver and the GMLSD 
DFB receiver) can also achieve the Genie Bound as the 
observation window length increases. By adopting the Viterbi- 
type trellis-search algorithm and the selective-store strategy, 
for both GLRT and GMLSD sequence receivers, the error floor 
problem has been completely avoided. 

Additionally, in Appendix A of this article, we argue that 
the intuitive detection method will have an error floor problem, 
and thus is not recommended. 


The right hand side of © can be expressed 


as 


I^on In 
—In 


A 0 - 


1 Ro 


Ron + r(k) N 0 - 

(i U )(i 

1 v on 


+ -R 0 ff In 

r(k) 


R 0 


■ r(k )^ 


A of f + r(k) N 0 h 


A c ff + 1 A c ff 


+ A 0 ff In 


—Ron In 


1 + 


r(k ) 


1 


A 0 ff - 

1 


T> 


r(k) 


N m 


+ Roft In 


1 + 


Ron ^(/c) A on Ron H - 
r(k) 1 r{k) 1 


Ron A off + 1 R 0 ff A off + 1 


(48) 


If L goes to infinity, we have R on oo, A 0 ff —>* oo, A on — >* 
oo, and A 0 ff —)> oo. Since lim^-^o ln(l + x) = x, we have 
that if L —>> oo 


1 r(k) 1 r(k) 

Aon Ron + r(k) Aon R 0 n + r(k) 


and 


r(k) 1 r(k) 1 

Ron A 0 ff + 1 A 0 ff A 0 ff + 1 

Thus, we have 
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lim A 0 n 

L—>■ oo 


In 


1 + 


+ A 0 ff In 
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A 0 ff A 0 ff + 1 


A 0 n A 0 ff 
A on A 0 ff + 1 


1 r(k) 
Aon A 0 n + 
r{k) 1 
A 0 ff A 0 ff + 1 _ 


+ r(k) 
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A on + r(k)' A on 
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A 0 ff + 1 


(51) 


Furthermore, we have 

A 0 n A 0 ff 
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L—yoo 

+ r(k) 
Rot 


N ol 

1 - 

RqS 

Nrf’ 


N 0 ff + 1 
Ron 


Ro 


1 1 

r(k) [ + Nj N 0 s H 


(52) 


and 


Appendix A 

From ( |4T| ), we know that the GLRT DFB receiver decision 
rule is 


r(k) In 


Aon In 


A 0 ff + 1 A on + r{k) 
_A 0 ff + r(k) A on + 1 


Aon + 1 Ro 
Ron + r(k) A on _ 


rh(k )=1 

i: 
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+ A 0 ff In 
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oo A 0 ff + r(k) A on + 1 A 0 ff A 0 

Finally, we can see that © can be reduced to 


(53) 


r *(fc) In 


NpS Ron 1 * W = 1 Ron _RoS ^ 

_ i?off N 0n _ m(/c)=0 A on A 0 ff 


If we substitute ( [33] ) into ©, we have the ML estimate of 

n r as 


A 0 n A 0 ff 
A on A 0 ff 


(47) 


n 5 


(55) 
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Substituting ( [33] ) and ( [55] ) into ( |54| ), we have 

1TT'(k') = 1 / rpt \ 

r(k) ^ n r / In ( 1 + A ) • (56) 

rh(k )=0 \ Tib J 

Comparing ( [56] ) with GD> we can see that they have the same 
structure and the only difference is that ( [56] ) uses estimated 
parameter values but ( [IT] ) uses ideally accurate ones. 

After adopting the selective-store strategy, we have 


n b 


2£t / i 


77 


,k 


L 


(57) 


where v® k is defined as the it h most recent received signal at 
time k that is detected to carry data symbol 0. If we ignore 
the impact of feedback errors and consider all r^’s as the 
received signal corresponding to the data symbol 0, r® k is a 
random variable with mean rib and variance rib. Therefore, 
fib is a random variable with mean rib and variance 2 rib/L. 
Clearly, if L goes to infinity, 2 rib/L goes to zero and fib 
approaches the true value of rib. Similarly, it can be shown 
that as L increases, fi r approaches its true value n r . Thus, we 
can conclude that as the observation window length increases, 
the BEP of the GLRT DFB receiver can approach the Genie 
Bound, and apparently, so does the GLRT sequence receiver. 
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